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THE INTERSECTION OF PAST AND FUTURE FOR 
MULTIVARIATE STATIONARY PROCESSES 

AKIHIKO INOUE, YUKIO KASAHARA, AND MOHSEN POURAHMADI 


Abstract. We consider an intersection of past and future property of mul¬ 
tivariate stationary processes which is the key to deriving various representa¬ 
tion theorems for their linear predictor coefficient matrices. We extend useful 
spectral characterizations for this property from univariate processes to mul¬ 
tivariate processes. 


1. Introduction 

We write C mxn for the set of all complex m x n matrices. Let {X(k) : k £ Z} 
be a C 9Xl -valued, centered, weakly stationary process, defined on a probability 
space (fwhich we shall simply call a q-variate stationary process. Write 
X(k ) = (X 1 (k ),..., X q (k)) T , and let M be the complex Hilbert space spanned 
by all the entries {Xj(k) : k £ Z, j = 1,..., q} in L 2 (H,J r , P), which has inner 
product {Y 1 ,Y 2 ) m '■= E[YiY 2 ] and norm ||Y||m := (Y, Y) 1 ^ 2 . For / C Z such as 
{n}, (— 00 , n] \= {n, n — 1 ,... }, [n, 00 ) := {n, n + 1 ,... }, and [to, n] := {to, ..., n} 
with m < n, we define the closed subspace M of M by 

M i~ := sp{Xj(fc) \j = l,...,q, he I}. 

Notice that = sp{Xi(n),... ,X q {ri)}. 

In this paper, we are concerned with the following intersection of past and future 
property of a g-variate stationary process {X(/e)}: 

(IPF) fl n= 1,2,3, — 

It is shown in m Theorem 3.1] that a univariate stationary process satisfies (IPF) if 
it is purely nondeterministic (PND) (see Section [2] below) and has spectral density 
w such that w^ 1 is integrable. We prove a multivariate analog of this sufficient 
condition for (IPF). More precisely, we show that a q -variate stationary process 
(A(fc)} satisfies (IPF) if {X(fc)j has maximal rank (see Section [2] below) and has 
spectral density w such that w~ l is integrable (see Corollarv l3.6l below'). We remark 
that such a process {A'(fc)} is PND. 

The importance of (IPF) for univariate stationary processes is that it, combined 
with von Neumann’s Alternating Projection Theorem (cf. jP, §9.6.3]), allows one 
to derive explicit and useful representations of finite-past prediction error variances 
(HUESHI]), finite-past predictor coefficients ( I1K2] 1. and partial autocorrelations 
or Verblunsky coefficients ; [ITT H1K 1\H:). of {X(fc)}. We can extend this approach 
introduced by m to multivariate stationary processes. In so doing, the sufficient 
condition for (IPF) stated above plays a crucial role. In our subsequent work, 
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under the (IPF) condition and using an argument which involves the Alternating 
Projection Theorem, we extend various known univariate representations for the 
finite-past prediction error variances, finite-past predictor coefficients, and partial 
autocorrelations to the multivariate setting. 

The property (IPF) is closely related to the property 

(CND) 

called complete nondeterminism by Sarason [S] . Pointing out that the essence of a 
spectral characterization of CND processes had been given by Levinson and McK¬ 
ean iLMj . Bloomfield et al. jBJH] considered various characterizations of univariate 
CND processes. For univariate stationary processes, the equivalence (CND) <$=> 
(PND) + (IPF) holds (see IK2) Theorem 2.3]). For g-variate processes, this equiv¬ 
alence is not necessarily true (see Remark 13.21 below). The main theorem of this 
paper is the equivalence between (IPF) and (CND) and their spectral character¬ 
izations similar to the univariate ones stated above, under the assumption that 
(X(fc)} is PND and has maximal rank (see Theorems 13.51 below h We prove the 
above sufficient condition for (IPF) that u> _1 is integrable as a simple corollary of 
this theorem. We also show an example of {X(fc)} with (IPF) for which w -1 is not 
integrable, as another corollary of this theorem. 

2. Preliminaries 

As stated in Section [l] let C mxn be the set of all complex m x n matrices, and 
I n the n x n unit matrix. For A £ C mxra ; we denote by A T the transpose of A, 
and by A and A* the complex and Hermitian conjugates of A, respectively. Thus 
A* := A T . 

Let T be the unit circle in C, i.e., T := {z € C : \z\ = 1}. We write a for the 
normalized Lebesgue measure dd/(2n) on ([— n, n), B([—n, n))), where B{[—n, tt)) 
is the Borel cr-algebra of [—7r, 7r). Thus we have cr([—7r, 7r)) = 1. For p £ [1, oo), we 
write L p { T) for the Lebesgue space of measurable functions / : T —>■ C such that 
ll/llp < oo, where 

( /*7T 'v 1/P 

ll/llp := {y J /(e<fl)IMd£,) } ■ 

Let L™ xn (T) be the space of C mxn -valued functions on T whose entries belong to 
L P ( T). 

For p £ [l,oo), the Hardy class H p ( T) on T is the closed subspace of L p ( T) 
defined by 

H p ( T) := j/ e: L p { T) : J e im9 f{e lB )a{dd) = 0 for m = 1, 2,... J . 

Let H™ xn (T) be the space of C mx "-valued functions on T whose entries belong 
to H P (T). Let B be the unit open disk in C, i.e., B := {z £ C : \z\ < 1}. For 
p £ [l,oo), we write H p ( B) for the Hardy class on B, consisting of holomorphic 
functions / on B such that 

sup f |/ [re l9 )\ p (j{dd) < oo. 

rE[0,l) J—tv 
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As usual, we identify each function / in H P (D) with its boundary function 

f(e z8 ) := lim/(re* e ) er-a.e. 
rfl 

in H p { T) (cf. Rosenblum and Rovnyak [RR.I V 

A function h in i?J xn (T) is called outer if det h is a C-valued outer function, 
that is, det h satisfies 

(2.1) log | det h(0)| = / log | det h{e l9 )\a(d,0) 

J —TV 

(cf. Katsnelson and Kirstein | KK 1 Definition 3.1]). 

Let {X(k)} be a q- variate stationary process. If there exists a nonnegative q x q 
Hermitian matrix-valued function w on T, satisfying w £ L qxg ( T) and 

E[X(m)X(n)*]= f e- i{m - n)e w{e ie )a(d9) 1 n,m£Z , 

J —TV 

then we call w the spectral density of {X(fc)}. We say that {A(fc)} has maximal 
rank if 

(MR) {A(fc)} has spectral density w such that detw(e ie ) > 0 er-a.e. 

(see Rozanov |B pp. 71 72]). A q- variate stationary process {X(fc)} is said to be 
purely nondeterministic (PND) if 

(PND) n n& Mf_^ nA = {0}. 

Every PND process {X(fc)} has spectral density but it does not necessarily have 
maximal rank unlike univariate processes (see IB Theorem 4.1]). So we combine 
the two to define the condition 


(A) {X(fc)} satisfies both (MR) and (PND). 

A necessary and sufficient condition for (A) is that (A(fc)} has spectral density w 
such that log det w G Li(T) (see [B Theorem 6.1]). 

Let {X(fc)} be a q -variate stationary process satisfying (A), and let w be its 
spectral density. Then, the spectral density w of {X(fc)} has a decomposition of 
the form 

(2.2) w(e l6 ) = h(e ie )h(e ie )* a- a.e. 

for some outer function h in iJ| x ®(T), and h is unique up to a constant unitary 
factor (see, e.g., [B Chapter II] and Helson and Lowdenslager ! 1 j 1. Theorem 11]). 

Lemma 2.1. We assume (A). Then, Xj(k), k £ Z, j = 1 ,...,q, are linearly 
independent. 


Proof. Let h(z) = ]C^Lo c(n)z n , z £ B, be the power series expansion of h , where 
{c(n)}]]]L 0 is a C 9X9 -valued sequence whose entries {cij(n)}yL 0 , i,j = 1 
belong to £ 2 . Then, there exists a q -variate stationary process {£(&)}, called the 
innovation process of {A(fc)}, satisfying A^n^m)*] = 5 n ^ m I q and 


X(n) = ^ c(n — fc)^(fc), n £ Z, 


k— —oo 

M (-oc ,„] = ^f-oc,n]: 


n £ Z, 
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where ^ := sp{^ (fc) : k < 0, j = 1,..., q} in L 2 (fl, T, P) (see Theorem 4.3 

in [Rj Chapter II]). 

Suppose J2k= m a (k)X{k) = 0 for n, to £ Z with m < n and a(k) £ C lx? , 
k = in ,..., n. Let Q be the projection operator from Ad onto the orthogonal 
complement of Then, 

0 = Q (J2 k=m a(k)X(k)j = a(n)c{0)f(n). 

Since £i(n),..., £ q (n) are linearly independent, we have a(n)c(0) = 0. However, 
c(0) is invertible by (12.Ill , whence a(n) = 0. In the same way, we also obtain 
a(n — 1) = • • • = a(m) = 0. Thus, Xj(k )’s are linearly independent. □ 

In addition to (12.21) . w has a decomposition of the form 

(2.3) w{e l6 ) = h${e ie )*h$(e ie ) a- a.e. 

for another outer function in H qxq (T), and /ij is also unique up to a constant 
unitary factor. In fact, for an outer function g in H qxq (T) satisfying w(e lS ) T = 
g(e lS )g(e l6 )* a- a.e., we may take = g T . It should be noticed that while we may 
take /i|j = h. for the univariate case q = 1, there is no such simple relation between 
h and /ij for q > 2. 

We denote by L{w) the complex Hilbert space consisting of all measurable func¬ 
tions / : T —>• C 1X9 with f(e ie )w{e ie )f{e lB )*a{d8) < oo, which has inner prod¬ 
uct 

( f,g)w~ [ f{e zB )w{e ze )g{e ze )*a(de) 

J —TV 

and norm \\f\\ w := (/, f)w 2 ■ For k £ Z and j = 1,..., q, we define ej(k ) £ L{w) by 
ej(k)(z) := (0,..., 0, z _fc , 0,..., 0), z £T, 

where z~ k is in the j-th coordinate. For an interval I C Z, let Lj(w) be the 
closed subspace of L(w) spanned by {ej(k) : k £ I, j = 1,... ,q}. By taking I q 
as w, we regard L 2 X 9 (T) as the complex Hilbert space L{d q ) with inner product 
( f,g)i q ■= J^f(e ie )g{e ie )*a(dd) and norm ||/||j, := (/, / and IL 2 1X9 (T) as its 

closed subspace. 

We put, for p £ [1, oo), 

Hp Xq (T) := {f : f £ H^ q (T)} . 

Lemma 2.2. We assume (A). Then, for n £ Z and outer functions h and h$ in 
H qxq {T) satisfying (12.21) and (12.31) . respectively, the following two equalities hold: 

(2.4) L(_oo,n]M = 2" ■ H 2 1X9 (T) ■ h~\ 

(2.5) L {nt00) {w) = z- n -Hl xq {T)-{h\)-\ 

Proof. We prove only (12.51) : one can prove (12.41) in a similar way. Define an antilinear 
bijection G : L[w) —»• L\ xq (T) by G(f) := //ij = fhj. Since 

l|G(/)H?, = \\fh;\\l = r f(e ie )h t (e ie r {f(e ie )h(e ie )*y a(dd) = \\f\\ 2 w , 

J —TV 

the map G preserves the norms of / £ L{w). Let 

(C lxq [z\ := sp{ej(fc) : k < 0, j = 1,..., q} 
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be the space of polynomials with coefficients in C lxq . Since hj is also an outer func¬ 
tion in H qxq ( T), it follows from the Beurling-Lax-Halmos Theorem that < C lxq [z\ • 
hj is dense in H\ Xf; (T) (cf. K K Remark 5.6 and Theorem 5.3]). Moreover, 

L [n,oo)(w) =sp {ej(k) : k > n, j = l,...,q} 

and 

G(sp{e i (fc) : k > n, j = 1,..., q}) = z n ■ <C lxq [z] • hj. 

Thus, 

L [n , oo)H = G- 1 (z n ■ Hl xq {jj) = z~ n • Hl xq { T) ■ 
as desired. □ 


3. The Past and future 

For a q -variate stationary process {X(fc)}, the next theorem holds without (A). 
Theorem 3.1. A q-variate CND process satisfies (IPF). 

Proof. For any q -variate stationary process (A(fc)}, we have 
(3.1) ^(-oo,n] = M (-oo,m-l] + M [m,n]» m, 71 £ Z, TO < Tl. 

For, the inclusion D is trivial, while My_ ooml , is closed and MN , is finite¬ 
dimensional, whence MY ,, + MY , is also closed (see Halmos [HI Problem 
8]), which implies C. 

For n £ N, let x £ Mjf^ _yPMjf_ n ^y Since x £ Mjf^ _ 1 ,, it follows from ED 
that x = y + z for some y £ M ( '^ 00j _ ri _ 1 , and z S MY n _ Y - Since x, z £ MA s, 
we have 

y = x - z £ M*_ 0O! „„_ 1 ] H Myi n oo y 
Therefore, if (A'(fc)} is CND, then y = 0 or x = z £ MA _ 1 ,, so that 




□ 


Since the converse inclusion D is trivial, {A(/c)} satisfies (IPF). 

Remark 3.2. The converse of Theorem l3.1l does not hold without additional assump¬ 
tions. For example, let {Y{k) : k £ Z} be a univariate CND stationary process; 
the simplest example is a white noise. Then |T(fc)} is PND. Define a two-variate 
stationary process {X(/c) : k £ Z} by X(k) ( Y(k — 1 ),Y(k)) T . For I CZ, let 
Mj := sp{F(fc) : k £ 1} in L 2 ( PI, T, P). Then, for n, m £ Z with n < m, we have 

M *-oo,n\ = M (-oo ,n]> M \ji,oo) = l,oo)J = M [n-l,m\- 

Since fl= {0}, {X(fc)j is PND. Furthermore, for n> 1, 


Mi 


x 


PM, 


x 


= M, 


Y 


PM, 


Y 


T-oo,-l] 1 1V1 [—n,oo) — JW (-oo,-l] 1 1V1 [—n—l.oo) 

whence |A(/c)} satisfies (IPF). However, 


= M, 


[-n-1,-1] 


= M, 




M, 


,-l] 1-1 ^[0,oo) - M (-oo,-l] ^ M [-l,oo) — ^{-1} 7^ {0}) 


whence {X(/c)} is not CND. Notice that (A(fc)} has the degenerate spectral density 

e ie w Y {e i9 ) x 

K e-" a w Y {e ie ) w Y {e ie ) 
where w Y is the spectral density of {T(/c)}. 


, iU\ i wyie 19 ) 
w x(e ) = I _ ie f 





6 


A. INOUE, Y. KASAHARA, AND M. POURAHMADI 


We assume (A), and for outer functions h and h% in satisfying (12.211 

and m , respectively, we consider the following two conditions: 

(3.2) {z- 1 • H^ xq (T) • (hj)- 1 } n {h 2 1X9 (T) ■ h- 1 } = {(0,..., 0)}, 

(3.3) {ih 1X9 (T) • (hj)- 1 } n {H 2 1X9 (T) • h” 1 } = C lx «. 

For any a G C 1X9 , we have a/i| G iL 2 X9 (T), ah G ih 2 x<? (T) and 

a = ahj(h|)- 1 = ahh" 1 , 

whence the inclusion D in (13.31) always holds. 

Let X(k) = e~ lke Z(dO ), fc G Z, be the spectral representation of (Al(fc)} 

satisfying (A), where Z is the random spectral measure such that 

E[Z(A 1 )Z(A 2 )*]= f w(e ie )a(d8), A,, A 2 G B([-n, tt)). 

J AiPlA2 

Define an isometric isomorphism S : L(w ) —> M by 

S(f) := f{e i9 )Z(dd), f G L(w). 

Then, S(ej(k)) = Xj(k) for k G Z and j = 1,..., q, whence we have 

(3.4) S{L I (w)) = M f, JcZ. 

Lemma 3.3. We assume (A). Then, the following two conditions are equivalent: 

(1) (13.21) holds. 

(2) M (-oo,0] n M [f,oo) = {0}- 

Proof. By (13.41) . (2) is equivalent to Lr OOi0 ](w’) FI Lr lj0O )(tu) = {(0,..., 0)}, which, 
in turn, is equivalent to (1) by Lemma 12.21 □ 

Lemma 3.4. We assume (A). Then, the following two conditions are equivalent: 

(1) (13.31) holds. 

(2) ^_ OOi 0]FM- oo) = Mf 0} . 

Proof. We have L{ 0 }(ru) = sp{ej(0) : j = 1,..., q} = C lx? . Hence, by (13.41) . (2) is 
equivalent to L(- O o,o]( u; ) F L[o i00 )(u>) = C lx? , which, in turn, is equivalent to (1) 
by Lemma T2. 2 1 □ 

Here is the main theorem of this paper. 

Theorem 3.5. We assume (A). Then, the following five conditions are equivalent: 

(1) (13.21) holds. 

(2) (13.31) holds. 

(3) (CND) holds. 

(4) M ( -^ 00i _ 1 j n M* n oo) = ni _ 1] for some n G N. 

(5) (IPF) holds. 

Proof. By Lemma [3731 (1) and (3) are equivalent. By Lemma HiTTl (2) (resp., (5)) 
implies (4) (resp., (2)). By Theorem 13.11 (3) implies (5). Suppose (4). Then, 

-^(-oo.-i] F Afp )00 ) C M ^_ 00 ^ 1 ] n 

^(-oc.-r, n MfJ )00) c M ( ^ 00in _ 1] n M* i00) = M^ n _ 1] . 





THE INTERSECTION OF PAST AND FUTURE 


7 


However, by Lemma l2Jl we have _ 1 , fl M; J„_i] = {0}, whence (3). □ 

The next corollary gives a sufficient condition for (IPF) in terms of the spectral 
density. 

Corollary 3.6. We assume (MR) and that the spectral density w of {X(k)} sat¬ 
isfies in -1 G L\ xq { T). Then {X(fc)} satisfies (IPF). 

Proof. Since = Xa=i |(^ _ 1 )ij '| 2 for j = 1 the condition w~ l G 

L\ xq (Y) implies /i _1 G L 2 X9 (T). Hence, by [KK1 Theorem 3.1] and |RR1 Theorem 
4.23], h - 1 G H| X9 (T), so that 

£T 2 1X9 (T) • /C 1 c H' 1 1X9 (T). 

Similarly, we have (/ijj) -1 G 7L| X<? (T), and 

H 2 1X9 (T) • (/ij)- 1 c Hp«(T). 

However, 7Lj lX9 (T) (~l H\ x, (T) = C lx? , whence (13.311 . Therefore, by Theorem 13.51 
(X(fc)} satisfies (IPF). □ 

Remark 3.7. A stationary process {X(k )} is said to be minimal if X(0) cannot 
be interpolated precisely using all the other values of the process. The condition 
w~ x G L\ xq (fl) in Theorem 3.5 is known to be necessary and sufficient for the 
minimality of a stationary process. See Section 10 of IB Chapter II], 

The next corollary gives an example of {X(fc)} with (IPF) for which w” 1 is not 
integrable (compare IP.)II Proposition 3]). 

Corollary 3.8. Let B be an invertible matrix in C qxq . Then (A(/c)} with spectral 
density w(e l8 ) = |1 + e l8 \BB* satisfies (IPF). 

Proof. We can take h = (1 + zfi^B and /i# = (1 + z) l ^ 2 B*. Suppose that there 
exist / = (fi,...,f q ),g = (gi,.. -,g q ) G H 2 1X9 (T) such that 

z^fifil)- 1 = gh~ 1 . 

Then, since (h^)~ 1 h = e l8 / 2 I q for z = e l8 (—7r < 6 < 7r), we have 

(3.5) e- lf> |/;,(e i;e )| = {gj(e l6 )} 2 , j = l,...,q. 

From ( gj ) 2 G ifi(T), we get 

(3.6) r e ime { 9j (e ie )} 2 a(d0) = 0 

J —TV 

for to = 1, 2,..., while, from ( fj ) 2 G H\(T) and (13.51) . we see that (13.61) also holds 
for m = 0, —1,..., whence gj = 0 for j = 1,..., q. Thus (13.21) holds. Therefore, by 
Theorem 13.51 {X(fc)} satisfies (IPF). □ 
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